Techniques for configuring a multimedia system

ABSTRACT

In one embodiment, a technique is provided to configure a home multimedia system. Software executing on a controller or other device access component profiles describing attributes of components, one or more zone configurations that indicate components that are present in one or more zones, and one or more connection configurations that indicates how components that are present in the one or more zones are interconnected. The software applies a set of predefined service rules to the data structures to generate workflows for possible services, wherein each service rule defines one or more components and one or more interactions required for providing a corresponding service, and each workflow indicates how one or more of the components that are present in the one or more zones interact to provide a service. Executable forms of the workflows are generated, and executed to provide services to a user.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.11/314,112 entitled PROGRAMMABLE MULTIMEDIA CONTROLLER WITH PROGRAMMABLESERVICES, filed on Dec. 20, 2005 by Robert P. Madonna et al., which ishereby incorporated by reference in its entirety.

This application is related to U.S. patent application Ser. No.11/314,664, entitled SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIACONTROLLER filed on Dec. 20, 2005 by Robert P. Madonna et al., which ishereby incorporated by reference in its entirety

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to the fields of multimedia andcommunications and, more specifically, to a programmable multimediacontroller for home, commercial, professional audio or video, broadcastor film studio, security, automation or other use which is capable ofinterfacing with, controlling and managing a wide variety of audio,video, telecommunications, data communications and other devices.

2. Background Information

Commercial offerings of consumer electronic devices have expandeddramatically in response to the falling cost of electronic hardware andintroduction of new media. For example, within only a few years, compactdisk (CD) technology largely displaced vinyl records and magnetic tapesas the music recording medium of choice, but was in turn displaced byMP3 technology. Similarly, digital versatile disk (DVD) technologylargely displaced videotape as the video recording medium of choice,while digital cameras have effectively replaced film cameras. The adventof new technologies and media, and the corresponding consumer demand forproducts based on the latest advances, drives manufacturers to rapidlyintroduce new products. As a result, an overwhelming number of producttypes and models permeate the market.

One long-standing problem which persists for many consumers is thecomplexity involved with interconnecting various electronic deviceswhich are typically sold individually and not as parts of an integratedsystem. For example, a consumer may acquire an audio receiver, cable TVbox, television, DVD player and surround sound system made by differentmanufacturers. The basic problem of interconnecting a group ofcomponents by a series of cables is challenging for many users, letalone sufficiently understanding the various modes of operations andfeatures which, if properly used, will allow the components to work besttogether and produce the most enjoyable entertainment experiences.

Another long-standing problem with most, if not all, previous approachesto integrating disparate components is that some type of centralcontroller is used which operates on software written in a high-levelcomputer language. The use of a high-level computer language presentsseveral difficulties. First, it is all but certain that the manufacturerwill not make the source code available to the user, thus effectivelypreventing a user who wished to customize a system from doing so.Second, even if the source code is made available, the overwhelmingmajority of users do not have the technical expertise, time orinclination to write or modify source code. Third, the introduction ofnew devices by manufacturers almost certainly necessitate that thesource code be modified in order to make the central controllercompatible with such devices.

Yet another long-standing problem is an absence of any widely adoptedindustry standard regarding control interfaces for consumer electronicsdevices. Manufacturers have incorporated varying communicationprotocols, most of which are proprietary in nature, do not conform toany standard, and are implemented with extremely detailed source code.This absence of standards greatly complicates the problem of how tointegrate and centrally control a wide variety of consumer electronicsdevices such that they work together and are manageable by an averageuser who does not possess substantial technical expertise.

SUMMARY OF THE INVENTION

In brief summary, the present invention provides a programmablemultimedia controller with programmable services. The multimediacontroller is based on a general purpose computer which controls aspecialized embedded computer system. The general purpose computer maybe matched with a second general purpose computer to provide redundancy.The multimedia controller is capable of interfacing with, controlling ormanaging a wide variety of audio, video, telecommunications, datacommunications or other devices.

The multimedia controller includes a programming environment forcreating services or user experiences that may incorporate features orfunctionalities of several devices that are conventionally operated asseparate, standalone devices. Such services may range in complexity fromsimple control functions to multimedia experiences that combine highperformance audio and video with the graphics capability of a generalpurpose computer, web-based services and telecommunications.

Services may be implemented according to various zones within a largerphysical space. For example, a user may specify that certain servicesare available in the family room of a home, while different services areavailable in the kitchen, depending upon the components that areavailable in each room or user preferences. Services may also beimplemented on a per user basis in conjunction with a user profile whichspecifies preferences, restrictions (e.g., parental controls) and thelike.

The programming environment includes a library of component profiles.Component profiles may be implemented in a number of ways based upondesired attributes of the underlying data structures. In a preferredembodiment, a component profile is implemented as an Extensible MarkupLanguage (XML) file which describes certain attributes of a componentsuch as a DVD player, television, amplifier or any other type ofcomponent that is capable of interfacing with the system of the presentinvention. A component profile typically describes at least some of thephysical characteristics of the component (e.g., the input/outputconnectors located on the back of the component), the configuration ofthe component (e.g., all possible types of modules that may be presentin the slots or bays of a modular receiver), the set of commands thatthe component recognizes (e.g., power on, power off, open disk tray), aswell as the functions that the component is capable of performing (e.g.,play, pause, stop).

Use of XML files for component profiles, as well as other aspects of thepresent invention discussed below, provides several advantages includingparticularly the ease with which component profiles may be created fornew components introduced into the market in the future. Further, theuse of XML makes the process of customization through editing existingcomponent profiles extremely simple as compared to writing or modifyingsource code. Accordingly, the present invention includes a programmingtool to assist installers or users who wish to create custom componentprofiles or modify prom files that are available in the library.

The library of component profiles may be stored on a hard disk drive orother storage media that is physically part of the system or otherwiseavailable to the system by way of a network or other communication link.One or more component profiles or even the entire library may beacquired, or updated as necessary, by accessing a designated websiteover the internet and downloading the appropriate files. Updating of thecomponent profile library may be implemented as an automatic process oras one in which a user initiates or controls the process.

Using the library of component profiles, the present invention allows auser to interactively describe how a particular installation is actuallywired through an on-screen tutorial. In the case of a new installation,the present invention may make recommendations to the user as to how towire an installation. Once wiring is established, the present inventionmay advise the user on what services are available.

The programming environment also includes zone configurations, which arealso preferably implemented as XML files. A zone configuration isessentially a description which includes an identification of whatcomponents are present in a particular room or other space, whichmodules are actually present within a modular component, how thosecomponents are interconnected and a specification of what type(s) ofcontroller is available to the user in that space.

The programming environment also includes connection configurations,again preferably implemented as XML files. A connection configuration isessentially a file that stores the installation wiring informationreferred to above and is used in determining what services can besupported by a particular installation.

The programming environment also includes service rules. A service rule,preferably implemented as an XML file, essentially defines whatcomponents are needed to implement a particular service and how aparticular component or group of components will interact to provide theservice.

Within the programming environment, component profiles, zoneconfigurations, connection configuration and service rules are allprovided as inputs to a configuration compiler, which produces a serviceimplementation, also preferably implemented as an XML file. The serviceimplementation is, in turn, supplied as an input to a workflow generatorwhich produces both an executable form of the service implementation aswell as a graphical representation of the executable form. The graphicalrepresentation advantageously provides a convenient and easy to useformat that may be displayed and edited using the general purposecomputer. By editing the graphical representation, a user is effectivelymodifying the corresponding executable form directly. In this fashion, auser with little or no programming expertise is able to create andcustomize programmable services as desired.

Another aspect of the present invention which also enhances the ease ofuse and programmability of the system is a user interface which, in apreferred embodiment, is based upon the functionality of a DVD playercoupled with widely available DVD authoring software. In this aspect,the present invention leverages two important considerations: a DVDplayer (i.e., the functionality of a DVD player as embodied in a videodecoder chip) is very inexpensive; and users are generally very familiarwith how to operate a DVD player to select items from displayed menus.Accordingly, a user interface which is very inexpensive, yet is readilyunderstood by a large majority of users, may be implemented usingcommercially available DVD authoring software. Such software may be usedto create videos which, when played, present information, menus orchoices with which the user interacts using a simple remote control,portable DVD player, touchscreen or any of a number of other controldevices supported by the present invention. As part of systemconfiguration and setup, one such video may be used to gather necessaryinformation to create one or more user profiles.

Another aspect of the present invention is its expandability. Multiplemultimedia controllers may be interconnected to form a larger system inwhich any input audio or video signal one controller may be switched toany output on the same or different controller. In such an expandedsystem, different controllers may be programmed to provide differentservices. For example, one controller may be programmed to providevideo-related services while a second interconnected controller may beprogrammed to provide audio-related services.

The services which the present invention may implement are diverse andvast in number. For example, assume that a user has the system of thepresent invention interfaced with a DVD player, a television and atelephone line. With those components, a simple service may be definedsuch that when a user is watching a DVD movie and receives a phone call,the system of the present invention will automatically command the DVDplayer to pause and cause the caller ID to be displayed in the videoframe on the television. As a result, the user may decide whether toanswer the call without physically going to the phone or manuallycontrolling the DVD player. If the call is answered, the DVD player willremain paused. If the call is not answered or is answered and thenfinished, the movie will automatically resume playing after a periodtime that may be programmed by the user.

Another example of a simple service that the present invention mayimplement involves the combination of a television and access to theinternet. The present invention may be used to access information fromthe internet, such as stock quotes, sports scores or weatherinformation, and display that information anywhere in a video image onthe TV screen or, alternatively, as a “ticker” that moves along thebottom of the image as the user watches a desired TV program.

Yet another example of a service that the present invention mayimplement involves the combination of a television and a wireless (cellphone). The present invention may be used to detect the arrival of ashort message service (SMS) text message by the cell phone and displaythe text message as an overlay on the image displayed by the television.In this fashion, the user is able to view the text message withouthandling the cell phone.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention description below refers to the accompanying drawings, ofwhich:

FIG. 1 is a block diagram of a home multimedia controller 100,interconnected to a number of devices, according to an illustrativeembodiment of the present invention;

FIG. 2 is a schematic block diagram showing the high-level hardwarearchitecture of the system of FIG. 1;

FIG. 3 is a schematic block diagram showing the high-level softwarearchitecture of the system of FIG. 1;

FIG. 4 is block diagram showing the major software components involvedin creating services which may be performed by the system of FIG. 1;

FIGS. 5A-5M show a component profile for a DVD player;

FIG. 6 shows a zone configuration for a receiver;

FIGS. 7A-7C show a connection configuration for a receiver;

FIGS. 8A-8H show a service rule for listening to a radio broadcast;

FIGS. 9A-9H show a service implementation for playing a CD in a DVDplayer which is connected with a receiver that is also connected tosurround sound speakers;

FIG. 10 is a screen shot of the automator workflow;

FIG. 11 is a diagram of a message structure for an applicationprogramming interface (API) for the controller of FIG. 1;

FIG. 12 is a message flow diagram showing how a device running Mac OS Xinteracts with the API of FIG. 11;

FIG. 13 is message flow diagram showing how a remote control whichtransmits radio frequency (RF) commands interacts with the API of FIG.11; and

FIG. 14 is a message flow diagram showing how a DVD player with S/PDIFoutput may be used a control device with the API of FIG. 11.

DETAILED DESCRIPTION OF AN ILLUSTRATIVE EMBODIMENT

FIG. 1 is a block diagram of a programmable multimedia controller 100,interconnected to a number of devices, according to an illustrativeembodiment of the present invention. The term “programmable multimediacontroller” should be interpreted broadly as a device capable ofcontrolling, switching data between, and/or interoperating with avariety of electronic devices, such as audio, video, telephony, data,security, motor-driven, relay-driven, and/or other types of electronicdevices . . . . By interacting with these devices the programmablemultimedia controller may implement an integrated multimedia controlsolution.

In the illustrative embodiment, the programmable multimedia controller100 is connected to a wide range of audio/video components, for example,a compact disk (CD) player 105, a digital versatile disc (DVD) player110, an audio/video receiver 115, a television 120, a personal mediaplayer 125, speakers 122, a microphone 123, and/or a video camera 124.The programmable multimedia controller may also be connected totelephony devices such as a telephone network 130 and telephone handsets132. The telephone network 130 may be a publicly switched telephonenetwork (PSTN), an Integrated Services Digital Network (ISDN) or othercommunications network.

In addition, the programmable multimedia controller may intercommunicatewith variety of light and/or home automation systems 135. These devicesmay operate via the X10 protocol developed by Pico Electronics, theINSTEON™ protocol developed by SmartHome, Inc, the CEBus standardmanaged by the CEBus Industry Council, or another well known homeautomation or control protocol. Similarly the controller may beconnected to motor and/or relay operated devices 137 that may include,for example, a heating, ventilation and air conditioning system (HVAC)system, an irrigation system, an automatic shade or blind system, anelectronic door lock, or other types of devices.

A computer network, such as the Internet 140, is connected to themultimedia controller. In addition, a personal computer (PC) 145, videogame systems 150, home recording equipment 165 or other devices may alsobe connected. Further, one or more remote control units 170 may beprovided to manage the controller's functionality, and/or to controldevices connected to the controller. Such remote control units may beinterconnected to the controller via a wired network connection, aninfra-red link, a radio-frequency link, a Bluetooth™ link, a ZigBee™link or another appropriate data connection.

In addition to providing interconnection to a wide variety of devices,the programmable multimedia controller is able to combine, synthesize,and otherwise processes various data types to implement an integratedmultimedia solution for a user.

To facilitate the above described interconnections and processing, theprogrammable multimedia controller 100 may be arranged in a modularmanner. For example, in one embodiment, the programmable multimediacontroller 100 is arranged to have twelve separate input and outputmodules, each having a number of connection ports. The input and outputmodules are inserted into slots or module bays of the programmablemultimedia controller 100. The modules interface with a mid-plane thatprovides connection to the rest of the system. By embracing a modularapproach, a user is allowed to select the specific modules desired, andthe system may be customized to fit a particular application. Inaddition, entry level pricing may be reduced by allowing a user topurchase a base configuration, with limited capabilities, and then addto the system by purchasing addition modules. Several examples ofmodules are discussed below, in reference to FIGS. 4-10, 12 and 13. Itis expressly contemplated that a wide variety of additional modules maybe provided, and, accordingly, this disclosure should be interpreted toembrace such other possible configurations. It is also contemplated thatseveral programmable multimedia controllers may be interconnected tocreate a larger system, in effect implementing a modular-type solutionat the controller level. Further details regarding such interconnectionand expansion may be found below in reference to FIGS. 18 and 19.

FIG. 2 is a schematic block diagram showing a high-level hardwarearchitecture of the programmable multimedia controller. The variouscomponents shown may be arranged on a “motherboard” of the controller,or on a plurality of cards interconnected by a backplane (not shown). Amicrocontroller 210 manages the general operation of the system. In theillustrative embodiment, the microcontroller is a 32-bit model MCF5234microcontroller available from Freescale Semiconductor Inc. Themicrocontroller 210 is coupled to an audio switch 215 and a video switch220 via a bus 218. The audio switch 215 and the video switch 220 arepreferably crosspoint switches capable of switching a number ofconnections simultaneously. However many other types of switches capableof switching digital signals could be employed, for example TimeDivision Multiplexing (TDM) switches. Further discussion of theseswitches may be found below in reference to FIG. 3 and FIG. 11.

A mid plane 235 interconnects the switches and other devices to avariety of input and output modules such as, for example, Digital VideoInput Modules with HDMI 600, Video Output Modules with HDMI 1000,Digital Audio Input Modules 400, and Digital Audio Output Modules 900.The mid plane 235 is further coupled to an Ethernet switch 230 thatpermits switching of 10BaseT, 100BaseT or Gigabyte Ethernet signals. TheEthernet switch 230 interconnects Ethernet ports 232 and a processingsubsystem 240 to the microcontroller 210. In one embodiment, theprocessing subsystem 240 includes a plurality of small form factorgeneral purpose personal computers that provide redundant operationand/or load balancing. In some embodiments, the processing subsystem 240may include one or more storage devices, external to the personalcomputers, to provide expanded storage capacity, for example, to storedigital media. Further discussion of the various embodiments of the dataprocessing subsystem 240 may be found below in reference to FIGS. 14-16.

Also, a number of Universal Serial Bus (USB) ports 242 areinterconnected to a USB hub 243 for interconnection to the processingsubsystem 240. A memory card interface 225 may also be connected to theUSB hub 243. The interface accepts one or more well known memory cardformats, for example CompactFlash™ cards, Memory Stick™ cards, SecureDigital™ (SD) cards, or other formats. A USB switch 244 is employed toswitch USB links among the multiple processing components that may bepresent. In a similar manner, a number of IEEE 1394 (FireWire™) ports246 are interconnected to an IEEE 1394 hub 247 and to an IEEE 1394switch 248.

The microcontroller 210 is further connected to a Serial PeripheralInterface (SPI) and Inter-Integrated Circuit (I²C) distribution circuit250, which provides a serial communication interface to relatively lowdata transfer rate devices. The SPI/I²C controller 250 is connected tothe mid-plane connector 235 and thereby provides control commands fromthe microcontroller 210 to the modules and other devices in theprogrammable multimedia controller 100. Further connections from SPI/I²Ccontroller 250 are provided to devices such as a fan controller 251, atemperature sensor 252 and a power manager circuit 253, which manage thethermal characteristics of the system and prevent overheating.

The microcontroller 210 is also connected to Infra-Red (IR) interface260, an RS232 interface 265, and an RF interface 267, that permitinterconnection with external devices. Such interaction permitsprogrammable multimedia controller 100 to control external devices. Inaddition the interfaces may receive control signals that control theoperation of the programmable multimedia controller itself. It isexpressly contemplated that various other interfaces, including WI-FI,Bluetooth™, ZigBee™ and other wired and wireless interfaces, may be usedwith the multimedia controller 100. Further discussion of suchinterfaces may be found below in reference to FIG. 17.

In addition, an Auxiliary Audio/Video Port 700 is provided forinterconnecting one or more video game systems, camcorders, computers,karaoke machines or other devices. A telephone interface 270 is providedfor connecting to the public switch telephone network or to a privatenetwork, and to telephone handsets. Further, a device control interface275 is provided to communicate with lighting, home automation, and motorand/or relay operated devices. As discussed in more detail below, anexpansion port 280 is provided for linking several programmablemultimedia controllers together to form an expanded system. Finally, afront panel display 1150 permits presentation of status, configuration,and/or other information to a user. In one embodiment the from panel candisplay video data originating from any input source connected to thesystem, such that one may preview video content on the display. Inanother embodiment the front panel display 1150 includes a touchsensitive screen, and a user may enter control selections by selectingicons on the screen.

FIG. 3 is a block diagram of the high-level software architecture of thecontroller 100. The software architecture is organized as a series ofplanes including a system control plane 302, a user interface (UI) plane304, a control application programming interface (API) access 306, aservice plane 308, a media plane 310, a component control plane 312 anda configuration/setup plane 314.

System control plane 302 includes the functionalities of a systemmanager 316, a system launcher 318, a redundancy manager 320, a webserver 322, a touchscreen/PDA server 324, a remote system access manager326 and system logs 328.

UI plane 304 shares a UI server 330 with service plane 308. Serviceplane 308 includes the functionalities of a service controller 332 whichitself includes an automator runtime 334. Service plane 308 alsoincludes the functionalities of a Mac display controller 336, anon-screen display (OSD) application 338, third party applications 340,Mac applications 342 and an audio/video component controller 344.Through automator runtime 334, service controller 332 is capable ofcontrolling Mac applications including iTunes, iChat, iPhoto and iDVDthat support Applescript, which enables application-to-applicationcontrol. Similarly, through automator runtime 334, service controller332 is capable of controlling other third party applications whichsupport AppleScript.

Media plane 310 includes the functionality of Mac input/output (I/O) inall supported formats (i.e., DVI, Ethernet, FireWire™, USB, etc.).Component control plane 312 includes the functionality of controllingaudio/video components 348.

Configuration/setup plane 314 includes the functionalities of a userconfiguration application 350, a configuration compiler 352, a userservices control application 354, a workflow generator 356 and a servicecontrol workflow browser/search engine/customization application 358.Configuration/setup plane 314 also passes several types of informationto UI plane 304 and service plane 308 including system configuration360, automator workflow 362, services definitions 364, componentprofiles 366 and Mac settings 368. As described in detail below inconnection with FIGS. 5-11, in a preferred embodiment, XML files areused to represent system configuration 360, automator workflow 362,services definitions 364 and component profiles 366.

The overall functional responsibilities of the various planes shown inFIG. 3 will now be discussed. In general, system control plane 302 hasresponsibility for high level system tasks and processes. Redundancymanager 320 has overall responsibility for redundancy arrangements whichmay be advantageously used in multimedia controller 100. For example,processing subsystem 240 may be implemented using two Mac Mini™computers as noted above. The use of two computers provides bothload-sharing capability as well as one level of redundancy in the eventhat one of the computers fails.

In order for the two computers to work properly when both are operatingproperly as well as when one of them fails, data stored on the harddrives normally accessed by only one of the computers must besynchronized. This is preferably done using rsync, a capability which ispart of the OS X operating system. In addition, one of the computerswill be designated as the “primary” computer based on an arbitrationthat takes place upon power up of the multimedia controller 100. The“secondary” computer operates in a subordinate role to the primarycomputer.

One embodiment of an arbitration begins with each computer advertisingits presence using the Bonjour Name Service. When one computer discoversanother computer, it will connect to the other computer. If bothcomputers are candidates to become primary, then the one with the highermedia access control Ethernet address will become primary. Each computerwill keep open a connection and “ping” one another. If the primarycomputer fails to respond to pings, then the secondary computer willassume the role of primary computer.

The primary computer is responsible for allocating streaming resourcesbetween itself and the “secondary” computer. Insertable/removable media(e.g., FireWire or USB drives, cameras, iPods) are connected to theprimary computer. Data collected by the primary computer from suchdevices may be passed to the secondary computer by shared mountpoints oranother technique.

Control API access 306 has responsibility for an API through whichmultimedia controller 100 may be controlled by a user who may choose touse a web-enabled device, an RF remote control type device, atouchscreen, a PDA or cell phone. UI plane 304 has functionalresponsibility for a user interface to multimedia controller 100.Service plane 308 has functional responsibility for implementingservices as described above. Automator runtime 334 is responsible forreceiving requests or commands from users and mapping them to a workflowfor a particular service.

Media plane 310 has functional responsibility for Mac I/O as well as theother internal and external communications interfaces supported bymultimedia controller 100. Component control plane 312 has functionalresponsibility for controlling the operations of audio or videocomponents which may be interfaced with multimedia controller 100.Configuration/setup plane 314 has functional responsibility for enablingusers to configure multimedia controller 100; to select, create ormodify services; and to select, create or modify component profiles.

With reference now to FIG. 4, the logical relationships among certainfunctional units depicted in FIG. 3 are shown in greater detail. Acollection of data which is stored internally to the system ofmultimedia controller 100 or obtained from an external source (e.g., adesignated website having a library of component profiles) is denoted byreference number 402. Data collection 402 includes component profiles,media types and service rules, preferably in the form of XML files, asdiscussed above. A second collection of data is provided by the user andis denoted by reference number 404. Data collection 404 includesconnection configuration and system configuration information, againpreferably in the form of XML files.

A user interacting with user configuration application 350, which ispreferably implemented in the form of an on-screen interactive tutorial,will generate the data contained in data collection 404. The tutorialmay be displayed on front panel display 1150 (FIG. 1) or on a televisionor other display which connected to multimedia controller 100. Inaddition, by using a microphone and speakers connected to the multimediacontroller 100 and utilizing the speech recognition/synthesiscapabilities which are part of the Mac OS X operating system, theon-screen tutorial may be enhanced for visually-impaired users. In thisfashion, instead of on-screen prompts, speech synthesized questions maybe asked of the user who simply speaks the answers.

Alternatively, user configuration application 350 may be implemented inthe form of an “offline” program that may be run on Mac computer orother device that is not necessarily connected to multimedia controller100. This implementation would be advantageous for professionalinstallers who wish to prepare a configuration in advance of physicalinstallation of the controller.

User configuration application 350 may be used to create user profilesdiscussed above. User profiles enable each user to personalize his orher system settings, styles, colors and the like for the on-screendisplay that multimedia controller 100 will present to that user. Userprofiles may also include service restrictions. For example, a userprofile for a child may contain information which blocks access to adultvideos or cable channels. A user profile may be implemented in the formof an XML file or other data file or structure which is compatible withother aspects of the system which require access to it.

A user interacting with a component profile tool 400 will effectivelyselect component profiles from those available in the library ofmultimedia controller 100, direct the controller to download a neededprofile from a designated website or other source, or possibly modify anexisting profile or create an entirely new profile as desired.

Component profile tool 400 may also include functionality for “learning”the IR or RF commands transmitted by a conventional remote control.Thus, a user who is creating a new component profile for a componentthat has a remote control may rapidly teach the remote control's commandset to component profile tool 400.

Component profile tool 400 may also work in conjunction with an opticalwand (not shown) by which a user may scan a manufacturer's bar codeslocated on a component chassis or possibly the component's packaging.Once a bar code is scanned, component profile tool 400 attempts to finda match in the component profile library or seek the appropriate profileof a designated website or other source.

Data collection 402 may also include application profiles, alsopreferably implemented as XML files, for controlling third partyapplications (e.g., iTunes, iChat) as part of a service. In a preferredembodiment, an application profile may be implemented as essentially alist of actions that are executed by running an Applescript. However,application profiles, like the other constructs described herein, may beimplemented in a variety of other ways.

Data collections 402 and 404 are supplied as inputs to configurationcompiler 352 which, in response, generates a service implementation. Theservice implementation is, in turn, supplied as an input to servicesdefinition 364. User services control application 354 enables a user toreview implemented services and to modify or remove them. Servicesdefinition 364 provides service definitions to service controller 332and to workflow generator 356. Service definitions includespecifications of what zones, services and components are in the systemconfiguration. Service controller 332 responds to the servicedefinitions by creating internal states and objects to manage the zones,services and components. Service controller 332 also uses the servicedefinitions to help identify what automator workflows sets will exist.

Using information contained in the services definitions, workflowgenerator 356 generates an initial “default” workflow set in both anexecutable form and a graphical representation. Each zone and service inthe service definitions has a workflow implemented for each request thatthe service implements. The executable form of the workflow is executedby service controller 332 (FIG. 3).

Workflow browser/search engine/customization application 358 may be usedto display, inspect and modify the graphical representations ofworkflows. When a user edits a graphical representation, thecorresponding executable form is automatically changed in accordancewith the user's edits. Consequently, a user is able to easily work withand customize workflows in a graphical programming environment, whileavoiding the complex logic and minutia of the underlying executables. Inaddition, speech recognition/synthesis capabilities which are part ofthe Mac OS X operating system may be utilized in conjunction with, or asan alternative to, the workflow browser/search engine/customizationapplication 358. Thus, as an aid to the visually impaired,

FIGS. 5A-5M show an example of a component profile, implemented in apreferred embodiment as an XML file. It will be understood by thoseskilled in the art that the component profiles, as well as any of theother constructs described herein, may be implemented in a variety ofways using well known techniques, languages and data structuresincluding databases accessible through standard query languages, closedbinary representations, text files, spreadsheets HTML files or otherfile-based data storage methods. More specifically, FIGS. 5A-5M show acomponent profile for an Integra model DPS-5.5 DVD player. The sectiondenoted by reference number 500 specifies that the DVD player has anRS232 serial communications port which may be used to control theplayer. Section 502 specifies that the DVD player has digital audiooutputs available at a coaxial connector as well as an opticalconnector. Section 504 specifies that the DVD player has component videooutput available at both a BNC connector as well as a coaxial connector,and that composite and S-video (left and right) outputs are available.

Section 506 specifies several possible status conditions that the DVDplayer may report: standby, playback, pause, stop and unknown.Similarly, section 508 specifies several media types that the DVD playermay report has been loaded into the player: DVD, VCD, CD, data orunknown. Any of these possible reports may be mapped into a givenservice and used as a triggering event for some action by multimediacontroller 100. For example, a report that a DVD has been loaded intothe player could cause the controller 100 to turn the power on to thetelevision (or other specified display) as well as the surround soundsystem in anticipation of a user wanting to view the DVD. Section 510specifies the input/output labels that are physically present on the DVDplayer's chassis.

Section 512 specifies the command which, when sent to the DVD player'sRS232 port, will turn the power on. Conversely, section 514 specifiesthe command which turns the power off. Section 516 specifies the commandto play. The remaining sections of FIGS. 5C-5M specify other RS232commands to which this particular DVD player will respond.

FIG. 6 shows a zone configuration, implemented as an XML file, for azone named “Lab” that uses an Integra model DTR-10.5 receiver as thezone master The zone also contains an NEC px-42xr3a plasma screenmonitor, a Motorola 62000 cable receiver, an Integra DPS-5.5 DVD/CDplayer and Bay Audio surround sound speakers, all as specified bysection 606. Section 600 specifies the physical input/output modules(and the slots that each occupies) that are installed in the receiver.Section 602 describes the format of an input defined by the receivercalled “DVD.” Because this particular Integra receiver has assignableinputs, a user may give the input a simple name. Thus, sections 602 and604 are needed to inform the configuration function of the presentinvention how the user has actually assigned the inputs on the receiver.

The configuration shows that the receiver has assigned an assignableinput name “DVD” to correspond to inputs named “Stereo IN 1” for audioand “Component IN 2” for video. Section 604 specifies the format of aninput defined by the receiver called “Video 1.” The configuration showsthat the user has assigned the “Video 1” input to be mapped to inputsnamed “Stereo IN 2” for audio and “Component IN 2” for video.

FIGS. 7A-7C show an example of a connection configuration for an Integramodel DTR-10.5 receiver. Section 700 specifies that an analog audiooutput (RCA connector) from an Integra DVD player is connected to stereoinput 1 (RCA connector) on the Integra receiver. Section 702 specifiesthat an audio output (RCA connector) from a Motorola cable TV box isconnected to stereo input 2 (RCA connector) on the Integra receiver.Section 704 specifies that a component video output (coaxial connector)from the Integra DVD player is connected to component video input 1(coaxial connector) on the Integra receiver. Section 706 specifies thata video output (coaxial connector) on the Motorola cable TV box isconnected to component video input 2 (coaxial connector) on the Integrareceiver.

Section 708 specifies that a component video output (coaxial connector)on the Integra receive is connected to a component video input (coaxialconnector) on an NEC plasma TV. Section 710 specifies that a set ofsurround sound 7.1 speakers are connected to the “Speakers A” terminalson the Integra receiver. Section 712 specifies that the Integra receiverhas an RS232 port through which it may be controlled. Similarly, section714 specifies that the NEC plasma TV has an RS232 port through which itmay be controlled.

FIGS. 8A-8H shows a service rule for listening to a radio broadcastwhich may be processed by a digital signal processor for desireddecoding or effects. Section 800 specifies the resources that are neededto implement this service: a radio source; an audio switch function (toswitch the input audio signal to the output device (speakers)); asurround sound processor function and surround sound speakers; or aradio source; an audio switch function; a volume control function; anamplifier function; and stereo speakers.

Section 802 specifies two universal requests, namely, power on and poweroff. Section 804 specifies volume control requests including mute on andmute off. Section 806 specifies a series of requests relating tosurround sound processing options. Section 808 specifies requestrelating to radio control including frequency selection, presetselection, display and scan.

FIGS. 9A-9H show a service implementation for playing a CD in a DVDplayer where the DVD player is connected to a receiver that is capableof surround sound processing. Section 900 specifies the following(audio) components that are needed to implement the service: an Integramodel DPS-5.5 DVD player; and Integra model DTR-10.5 receiver (whichincludes surround sound processing capability); and a set of surroundsound speakers. Section 902 specifies all user requests or commands thatthe DVD player and receiver will recognize.

FIG. 10 is a screen shot showing an example of a workflow when viewedusing Apple Computer, Inc.'s Automator application. The Automatorapplication, which is supplied as part of the Mac OS X operating system,provides a simple graphical programming capability. Such an environmentprovides a convenient, easy to use environment for viewing and modifyingworkflows created using the present invention. However, those skilled inthe art will understand that other third party graphical programmingenvironments could be used or adapted for use with the present inventionor such an environment could be created specifically for use withmultimedia controller 100.

In FIG. 10, the panels numbered 1000, 1002 represent discrete actionswhich are to be executed consecutively. For example, in panel 1000, thespecified action is to turn on the power to an Integra model DPS-5.5 DVDplayer. In panel 1002, the specified action is to turn on the power toan Integra model DTR-10.5 receiver.

FIG. 11 is a diagram of a message structure for an applicationprogramming interface (API) for the controller of FIG. 1. Each messageincludes a header portion 1100, which may implemented using any ofEthernet, IP, TCP or UDP header. Header portion 1100 is followed by apayload portion 1102. Payload portion 1102 includes information whichidentifies a zone, service, event and event type. Payload portion 1102may implemented simply as variable length strings of ASCII characters,but may also be implemented using any of a variety of other well knowndata types or structures.

FIG. 12 is a message flow diagram showing how a device running Mac OS Xinteracts with the API of FIG. 11 and is used to control the operationof multimedia controller 100. A device running Mac OS X is denoted byreference number 1200. In a preferred embodiment, device 1200 willinitially attempt to autodetect a server (i.e., interface server 330(FIG. 3)) by way of the Bonjour Name Service search broadcast 1202 whichis part of OS X. User interface server 330 includes Bonjour NameRegistration 1204. A Bonjour Service Discovery message 1206 is issued bydevice 1200 and received by user interface server 330. This is followedby a registration request 1208 which is processed by Bonjour NameRegistration 1204 and acknowledged by way of registration confirmationmessage 1210.

Once device 1200 is registered, subsequently, a user presses a button1212 (e.g., increase the volume on the TV) which causes a commandindication 1214 to be issued to user interface server 330. Commandindication 1214, as well as command request 1220, command confirmation1222 and command indication 1226, would, in general, be constructed inaccordance with the message structure shown in FIG. 12.

User interface server 330 recognizes command indication 1214 as acontrol command or request and responds by issuing a send commandmessage to service controller 332 (FIG. 3) which reacts according to theapplicable service implementation to raise the volume on the TV.

In the case of an interactive command 1218 (e.g., a user wishes to viewalbum cover art), which requires data from user interface server 330, acommand request 1220 is issued by device 1200 to user interface server330. User interface server 330 replies with a command confirmation 1222which returns the requested data to device 1200.

In the case of an unsolicited interactive command 1224 (e.g., a userloads a DVD into a DVD player or disconnects a component), userinterface server 330 simply issues a command indication 226 to informdevice 1200 of the event.

FIG. 13 is message flow diagram showing how device 1300, such as aremote control, which transmits radio frequency (RF) commands interactswith the API of FIG. 11.

A “raw” RF command 1302 is initially transmitted by device 1300. Userinterface server 330 received the RF command and converts 1304 it to azone/service/event/event type message like that shown in FIG. 11. Theconverted message is then sent 1306 to service controller 332 whichreacts according the applicable service implementation.

FIG. 14 is a message flow diagram showing how a DVD player with aSony/Philips Digital Interconnect format (S/PDIF) output may be used acontrol device with the API of FIG. 11. A conventional DVD player (orsimply a video decoder chip which implements the basic functionality ofa DVD player) 1400 is supplied with a special DVD that may contain, forexample, an interactive or menu-driven video which presents a series ofmenus, a system “control panel” or similar control options to a user. Asthe user chooses control options, DVD player 1400 responds by producingan output audio stream in which control information is embedded. TheS/PDIF output sound file is converted by an adaptor 1402 to WiFi S/PDIFmusic 1408 which is transmitted wirelessly to an S/PDIF receiver 1404which part of multimedia controller 100 (FIG. 1). Receiver 1404 convertsthe received S/PDIF music 1408 to a command 1410 which passed to userinterface server 330.

Examples of Services

We will now describe representative examples of services that may beimplemented using the present invention. It will be understood by thoseskilled in the art that the following description is by way of exampleonly and that the present invention is capable of providing far moreservices, both in type and quantity, beyond the specific examplesdescribed here.

Video-Related Services

A service which provides videoconferencing, including multipartyvideoconferences, may be created and used with the present invention.Video signals and audio signals for a video conference may originatefrom either the internet 140 (FIG. 1), PSTN 130 or another source whichis interfaced with multimedia controller 100. If desired, video signalsmay be carried over the internet while corresponding audio signals arecarried by the PSTN. This arrangement provides superior audio quality ascompared to a videoconference in which the audio signals are carriedover the internet.

Another service which the present invention supports is video chat,including multiparty chat. Such a service may be based in whole or inpart on iChat or similar functionality available from third parties.

Another service which the present invention supports is video mail,which may be thought of as email in which the content is video asopposed to text or graphics.

Another service which the present invention supports is video withintegrated telephony features. Such a service provides a “picture inpicture” display on a television or other display device for showingcaller ID or other information relating to an incoming call. Such asservice may also provide display of text messages or provide unifiedmessaging through a single in-box in which a user would receive email,video mail, voicemail, fax, etc.

Another service which the present invention supports is video on demand(VoD) or video podcasting in either high definition or standarddefinition.

Another service which the present invention supports is video processingincluding one more of the following functions: color space conversion;flexible input capture size; adjustable gamma conversion; keying; motionprocessing; zoning; diagonal compensation; multiple live inputs; 3Dnoise reduction; alpha blending; intelligent image sharpening; seamlessswitching; video upconversion; video scaling and resizing; HD-DVDrecording, playback and editing; DVD playback; DVR/PVR capabilities;MPEG decoding/encoding; video transcoding; and surround sound decoding(i.e., Dolby and DTS).

In general, any of the foregoing or other video-related services may becreated to work with any of the major digital video encoding standardsincluding MPEG-2, MPEG-4 AVC, DivX, JPEG, BMP and PNG for images.

Messaging-Related Services

A service which provides instant messaging is supported by the presentinvention. Such a service may also provide short message service (SMS)functionality.

Audio-Related Services

A service which the present invention supports provides one or more ofthe following radio functions: internet radio; high definition radio;FM; AM; and satellite radio.

Another service which the present invention supports is a digitaljukebox including the ability to create “smart” playlists based on userpreferences. Such a service may include organization and display ofmetadata relating to artist and title as well as automatic retrieval ofsuch metadata over the internet (e.g., Gracenote® MusicID or otherservice).

Another service which the present invention supports is karaoke, whichmay be implemented with either wired or wireless microphones.

Another service which the present supports is speechrecognition/synthesis, the basic functionality of which is part of theMac OS X operating system. Such a service may also be based in whole orin part on third party speech recognition/synthesis which is compatiblewith multimedia controller 100.

Games-Related Services

A service which the present invention supports is interactive gamesincluding on-line games and whole-house games.

Home Automation and Security-Related Services

A service which the present invention supports is security includingremote surveillance over the internet, intelligent security, alarmsystem control, lighting control, HVAC control, sprinkler system controland use of DVR/PVR for security video recording.

The present invention also supports a service for remote monitoring anddetection of a user's health as well as telemedicine.

Configuration, Management and Control-Related Services

As discussed in detail above, the present invention provides substantialassistance and convenience to a user in connection with configuration ofmultimedia controller 100 through an on-screen tutorial and the like.Once a system is initially configured and running, the present inventionsupports a service in which whenever a computer or other device whichmay contain digital media is connected to multimedia controller 100,designated folders or areas of that computer or device may be scannedfor new media not already available to the controller. Any new media maybe automatically downloaded to the controller and stored according to alibrary or other organization specified by the user.

Similarly, the present invention supports a service in which multimediacontroller 100 is always on/always monitoring and automaticallydiscovers and identifies new components when they are interfaced withthe controller. In addition, once a new component is identified, such aservice may advise the user through on-screen information, e-mail orother media that the new component is recognized and further advise asto new services which the user may wish to activate to make use of thecomponent.

Another service which the present invention supports is control of liveand recorded TV including time shifting.

Another service which the present invention supports is remotesynchronization of portable devices including portable audio and videoplayers, PDAs, computers and the like. Similarly, the present inventionsupports a service in which remote content is scheduled for retrievaland storage on DVR/PVR.

Digital Music-Related Services

The present invention supports a service for recording audio either liveor from another source. Such a service may be based in whole or in parton GarageBand from Apple Computer.

Another service which the present invention supports is integration withmusic purchasing services including iTunes music store, Napster ToGo,Yahoo! Music and the like.

Another service which the present invention supports is a DJ mixingplatform including one or more of the following functions: automaticmixing; one-click beat-matching; seamless looping; automatic BPMcounter; vinyl simulation including scratch, pitch, and reverse play;separate headphones output and song pre-listening; and mix recording.

Another service which the present invention supports is an e-musicstudio including one or more of the following functions: route; map;filter; convert; display; input and output MIDI messages in realtime.

Another service which the present invention supports is an internal drummachine and loop generator.

Another service which the present invention supports is an interactiveon-screen display chord book generator;

Another service which the present invention supports is integratedmusician tools including one or more of the following capabilities:guitar tuner; chromatic and tonal; alternate tuning editor; chordlibrary; tablature organizer; jam machine; and metronome. Such a servicemay also include music collaboration and playing which may be based inwhole or in part on eJamming™ or other third party software.

Digital Media Server-Related Services

The present invention supports a service which provides a digital mediahub with integrated digital media adapter. Such a service may alsoprovide a digital media server capable of serving video, audio, digitalphotos, data, voice and supporting major audio compression techniquesincluding MP3, AAC, Apple Lossless Compression, FLAC, Ogg Vorbis andMonkey's Audio

Whole-House Digital Media Distribution-Related Services

The present invention supports a service which provides one or more ofthe following functionalities: whole-house audio including multi-zonewhole-house audio distribution; whole-house video including multi-zonewhole-house video distribution; whole-house games including multi-zonewhole-house gaming distribution; and whole-house visualizer fordistributing different visualizers to different zones (rooms) playingdifferent music (audio) content independently. Such a service may alsoprovide whole-house digital alarm clock and reminder functionalityincluding displaying reminders or performing automated tasks;integration with Digital Jukebox (QuickTime/iTunes); playing mediafiles, web broadcasts and CDs/DVDs; performing wake-up and reminderprompts with user specified digital media content including internetradio, MP3 and Digital Jukebox Playlist; and automaticallycomposing/sending email including video mail reminders.

VOIP/Telephony/IP PBX-Related Services

The present invention supports a service which provides voice over IP(VOIP) capabilities including integrated analog telephony adapter (ATA),IP private branch exchange (PBX) and IP key system. Such a service mayalso provide intelligent call screening, voice activated dialing, colorring back tone integration, follow-me/find me service andinbound/outbound call management.

For handling incoming phone calls, a service may be implemented in whichthe caller ID information is collected (this capability is present intelephone interface 270 (FIG. 2) which includes an FXO interface). Theservice may report or display the caller ID information to one or moreuser interfaces as desired. In addition, using the caller IDinformation, a lookup may be performed in a user's address book todetermine if the calling party is listed there. If there is a match inthe address book, the multimedia controller 100 may display at the userinterface the calling party's name, picture or other information insteadof or in addition to the phone number. Advantageously, the user is notrequired to do anything other than operate a telephone set in thecustomary manner.

For handling outgoing phone calls, once a telephone set is taken offhook and a user begins to dial, the digits may be collected (DTMF tonedetection capability is present in telephone interface 270 whichincludes an FXS interface). Again, a lookup to the user's address bookwill determine if the call is being placed to someone listed in thebook. If so, the user may now be offered particular options (these maybe simply announced to the user over the phone or displayed on a videodisplay), associated with the party who is being called, for completingthe call. For example, if the address book shows that the party who isbeing called has videophone capability, a Skype account, iChat orsimilar service, the user may select any of those options to completethe call. The user may select a call completion option by simplypressing a button on the phone, making a selection on a touchscreen orthrough any of a number of other user interfaces supported by thepresent invention. Again, the user is not required to know any specialcommands or complicated operational steps because he or she is simplyusing a telephone in the customary way.

Other services may also be implemented where a user operates a telephonein the normal fashion, but is enabled to open or close a gate, a garagedoor, lights and the like.

Online-Related Services

The present invention supports a service which provides a personalassistant or concierge service for obtaining, organizing and displayingentertainment-related or other information within the home or othersetting. Such a service may provide for on-screen display or other userspecified media information on weather, sports, stocks, on-line ticketpurchases, on-line reservations, email, shopping list creation andsynchronization with PDA or other portable devices, recipes and trafficreports including video.

While certain embodiments of the present invention described above makeuse of various functionalities provided by the Mac OS X operating system(e.g., Automator, Applescript), the present invention does not requirethat particular operating system in any way. The present invention,including in particular the programmable services aspect of theinvention, may be implemented in connection with any desired operatingsystem including without limitation Windows and Linux.

The foregoing description has been directed to particular embodiments ofthis invention. It will be apparent, however, that other variations andmodifications may be made to the described embodiments, with theattainment of some or all of their advantages. Additionally, theprocedures or processes may be implemented in hardware, software,embodied as a computer-readable medium having program instructions,firmware, or a combination thereof. Therefore, it is the object of theappended claims to cover all such variations and modifications as comewithin the true spirit and scope of the invention.

What is claimed is:
 1. A method of configuring a home multimedia system,comprising: accessing, by software executing on a controller of the homemultimedia system, data structures that include: component profilesdescribing attributes of components of the home multimedia system,wherein the components include at least one audio/video (A/V) device,telephony device, lighting device, heating ventilation and cooling(HVAC) device, automatic shade or blind device, or electronic door lock,and the attributes of a component include at least a set of commandsthat the component recognizes as well as one or more functions thecomponent is capable of performing, one or more zone configurations thatindicate components that are present in one or more zones of a structureassociated with the home multimedia system, and one or more connectionconfigurations that indicates how components that are present in the oneor more zones are interconnected; applying, by the software executing onthe controller, a set of predefined service rules to the data structuresto generate workflows for possible services, wherein each service ruledefines one or more components and one or more interactions required forproviding a corresponding service, and each workflow indicates how oneor more of the components that are present in the one or more zonesinteract to provide a service; generating executable forms of theworkflows; and executing the executable forms of the workflows toprovide services to a user.
 2. The method of claim 1, furthercomprising: removing a workflow for at least one possible service basedupon the user profile of the user of the home multimedia system, whereinthe generating generates executable forms of remaining workflows.
 3. Themethod of claim 1, wherein the workflows are default workflows, and themethod further comprises: customizing, in response to user input in aconfiguration application, at least one of the default workflows tochange how components that are present in the one or more zones of thestructure interact to provide the service.
 4. The method of claim 3,wherein the customizing further comprises: displaying a graphicalrepresentation of a default workflow to the user in the configurationapplication; receiving an edit to the graphical representation from theuser; and automatically updating the executable form of the defaultworkflow based on the edit to the graphical representation.
 5. Themethod of claim 4, wherein the graphical representation comprises aplurality of panels that each represent discrete actions that are to beexecuted consecutive by the one or more of the components that arepresent in the one or more zones to provide the service.
 6. The methodof claim 1, wherein the workflows are default workflows, and the methodfurther comprises: customizing the default workflow at least onepossible service based upon a user profile of the user to change howcomponents that are present in the one or more zones of the structureinteract to provide the at least one possible service.
 7. The method ofclaim 1, wherein the accessing further comprises: downloading over theInternet the component profiles from a repository.
 8. The method ofclaim 1, wherein the accessing further comprises: receiving the one ormore zone configurations and the one or connection configurations from aconfiguration application executing on the controller or another deviceof the home multimedia system.
 9. The method of claim 1, wherein eachservice rule further defines one or more requests the correspondingservice is capable of responding to, and the executing furthercomprises: receiving a command indication from a remote control of thehome multimedia system; determining the command indication correspondsto a request of a particular service; and executing the executable formof a workflow for the particular service to provide the particularservice to the user in response to the command indication.
 10. Themethod of claim 1, wherein the executing further comprises: issuing, bythe controller, one or more of the commands that the one or morecomponents recognize to execute the workflows.
 11. A non-transitoryelectronic device-readable medium storing program instructions that whenexecuted on one or more devices of a home multimedia system are operableto: access data structures that include: component profiles describingattributes of components of the home multimedia system, wherein thecomponents include at least one audio/video (A/V) device, telephonydevice, lighting device, heating ventilation and cooling (HVAC) device,automatic shade or blind device, or electronic door lock, and theattributes of a component include at least a set of commands that thecomponent recognizes as well as one or more functions the component iscapable of performing, and one or more zone configurations that indicatecomponents that are present in one or more zones of a structureassociated with the home multimedia system; and apply a set ofpredefined service rules to the data structures to generate workflowsfor possible services, wherein each service rule defines one or morecomponents and one or more interactions required for providing acorresponding service, and each workflow indicates how one or more ofthe components that are present in the one or more zones of thestructure interact to provide a service; customize the workflow of atleast one possible service based upon a user profile of a user of thehome multimedia system to change how components that are present in theone or more zones of the structure interact to provide the at least onepossible service; generate executable forms of the workflows; andexecute the executable forms of the workflows to provide services to theuser.
 12. The non-transitory electronic device-readable medium of claim11 wherein the program instructions when executed are further operableto: download the component profiles from a repository over the Internet.13. The non-transitory electronic device-readable medium of claim 11wherein the program instructions when executed are further operable to:receive the zone configurations and connection configurations from aconfiguration application executing on the controller or another deviceof the home multimedia system.
 14. The non-transitory electronicdevice-readable medium of claim 11 wherein each service rule furtherdefines one or more requests the corresponding service is capable ofresponding to, and the program instructions when executed are furtheroperable to: receive a command indication; determine the commandindication corresponds to a request of a particular service; and executethe executable form of a workflow for the particular service to providethe particular service to the user in response to the commandindication.
 15. The non-transitory electronic device-readable medium ofclaim 11 wherein the program instructions when executed are furtheroperable to: issue one or more of the commands to the components thatthe one or more components recognize based on the workflows.
 16. A homemultimedia system, comprising: a plurality of components associated withone or more zones, wherein the components include at least oneaudio/video device, telephony device, lighting device, heatingventilation and cooling (HVAC) device, automatic shade or blind deviceor electronic door lock; a controller configured to control and/orinteroperate with the components, the controller including a processingsubsystem; and software executable at least in part on the processingsub-system of the controller, that when executed is operable to: accessdata structures that include component profiles describing attributes ofthe components, wherein the attributes of a component include at least aset of commands that the component recognizes as well as one or morefunctions the component is capable of performing, and one or more zoneconfigurations that indicate components that are present in each of theone or more zones; apply a set of predefined service rules to the datastructures to generate workflows for possible services, wherein eachservice rule defines one or more components and one or more interactionsrequired for providing a corresponding service, and each workflowindicates how one or more of the components that are present in the oneor more zones interact to provide a service; receive a commandindication from a device controlled by a user of the home multimediasystem; determine the command indication corresponds to a request of aparticular service; and issue one or more commands to the componentsthat the one or more components recognize based on the workflow for theparticular service to provide the particular service to the user. 17.The home multimedia system of claim 16, wherein the software whenexecuted is further operable to: display a graphical representation of aworkflow to the user; receive an edit to the graphical representation ofthe workflow from the user; and update the workflow in response to theedit to the graphical representation.
 18. The home multimedia system ofclaim 17, wherein the graphical representation comprises a plurality ofpanels that each represent discrete actions that are to be executedconsecutive by the one or more of the components that are present in theone or more zones to provide the service.
 19. The home multimedia systemof claim 16, wherein the workflows for services are default workflows,and the software when executed is further operable to: customize aworkflow of at least one possible service based upon a user profile ofthe user to change how components that are present in the one or morezones of the structure interact to provide the at least one possibleservice.
 20. The home multimedia system of claim 16, wherein theworkflows are default workflows that are executed absentuser-customization.